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The present. invention relates generally to a system, method, and apparatus for providing 
real-time or near real-time interpreting services for utilization on a network. More specifically, 
embodiments of the invention relate to systems, methods, and apparatuses for facilitating 
communication for the hearing impaired or disabled in situations that are location-specific and in 
which the use of live interpreters is inconvenient or relatively neither cost nor time effective, 
wherein a real-time or near real-time interpreting service is provided, via a network. 


^ Cui T eiilly 23,000,000 Americans aie classified as liaviugohronio hoaring impairment. — 
Based on figures compiled by the National Center for Health Statistics, it is estimated ti*ar 
7,600,000 physician contacts occur annually with hearing disabled patients^Smergency room 
situations. In addition, it is estimated that and additional 6,800X)9€fsuch contacts occur in 
outpatient facilities. These numbers are forecast to CTp^over the next decade. The Americans 
With Disabilities Act (ADA) requires healthpare facilities to make "reasonable accommodation" 
for the hearing disabled. Legal prgaetfent for the reasonable accommodation" standard has been 
established in a numbgjxfisuits. While live interpreters and transliterators meet this standard, 
their use inperfentially life threatening situations has major disadvantages in cost, time delay and 
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Conu^jiriication is central to human interaction. Without communication between 
persons, the daily processes of our society and human interaction cannot take irface, and the 
social processes of healthcare, commerce, public services, education, tray^l and religious 
observance could not function, aWe know them. The efficiency atfa effectiveness of social 
institutions depend wholly on the degre^to which essential ii^rmation can be conveyed, 
processed by the recipient and responded to within an amJropriate time frame. Those who 
cannot communicate in such contexts are fhistrate<yracluded and isolated to varying degrees 
from our society. The costs of such exclusion/fre significant in terms of unrealized potential; 
unrealized opportunities for commerce; Legal liabilities includmg&scrimination, product/public 
liability and compliance with the American With Disabilities Act; arid, not least, risk to human 
life and health. / \ 

Figures compilecj^n 1996 by the U.S. National Center for Health StatStics figures 
indicate that 22,044*000 Americans are classified as having "Chronic Hearing Impkmnent " 
Utilizing U.S^2ensus population trend data it can be estimated that this number will gnW to 
nearly 23 J300,000 in the year 2000 and to nearly 27,000,000 in the year 2020 or close to 8^of 
the totel population. 
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Hearing Impaired Population : Projected Growth 
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In light of these statistics, it is evident that aVlgnificant market need exists for services designed 
to facilitate communication for the hearing impaired and that this market will continue to grow 
over the next 20 years. Indeed it may be argued tha/the market will expand faster than the 
above prediction given the aural assault inflicted/on u^by modern city living. 

Currently, the market need is served m a number o5ways including assistive listening 
devices, closed captioning, telephone basso services such as TTY and TDD, pictograms and sign 
language. Further, the needs of the deaf and hearing impaired areurecognized within the 


provisions of the Americans WitlLDisabilities Act ("ADA") which requires that services and 
institutions bound by the AD A/make "reasonable accommodation" for those disabled by hearing 
1 0 impairment. The ADA interprets reasonable accommodation as being theVrovision of "auxiliary 
aids and services" including "qualified interpreters or other effective method9^)f making aurally 
delivered materials/available to individuals with hearing impairments." In othefyords, 
institutions involved in healthcare, commerce, public services and education are bound to 
provide "auxiliary aids and services" for the 23,000,000 million Americans currently classified 


15 as having chronic hearing impairment. 
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In the neatthcare market, notably for emergency room, paramedic and/ln-hospital 
situations, there is a c^ar and significant need to better serve the requirements of hearing 
impaired patients. Under bhsy emergency room and paramedic situations delays and confusion 
experienced in communication Between medical staff and patients are obviously life threatening 
5 but also have a costly flow-on effect in demanding greatennme input from medical staff at the 
expense of other incoming patients. Whilk sign language interpreters and other "auxiliary aids" 
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are employed in these situations, they are costlVand can involve significant time delays while 
interpreters are located and travel to the facihfy or emergency location. 

Statistics compiled by the U.S. National Centerof Health Statistics indicate that in 1995 
there were 67,232,000 physician comacts with deaf or heaiW impaired patients at the outpatient 
level and 96,545,000 physicia^contacts with deaf or hearing impaired patients at emergency 
room level. Assuming a Jr/o growth rate in emergency room contacrl(10% in outpatient 
contacts) every 2 yeare and a constant 8% of the population with chronicSbearing impairment the 
following growtja trend of emergency room and outpatient contact with hearing disabled patients 


can be extrapolated: 
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Hearing Impaired : Physician Contact Projections 
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During the next 10 years emergencVroom contact with hearing disabled patients is 
estimated to rise gradually from 7,600,000 to ^00,000 instances per year, and outpatient 
s5 contact with hearing disabled persons will rise ste)fclily from 6,800,000 to nearly 1 1 ,000,000. 


Each and every one of these instances represent a situation where communication is hampered 
and the institution involved is required to m£ke "reasonable accommodation" for the needs of 
the hearing disabled individual. Several legal precedents have now been established in this area. 


The California group Disabled^Rights Advocates ("DRAT) has sued Health Net, a 
10 statewide health maintenance organization regarding access to heaHh care by deaf and hard-of- 
hearing participants. Health Net is a "preferred provider" organizationVparticipants can only use 
selected physicians who contract with Health Net. Consumers with heariflg disabilities, 
therefore, must choose irom these selected doctors even if none of the physicians know 
American Sign Language. This case is expected to have a dramatic impact on theJiealthcare 
15 industry becausykMOs generally do not have policies to ensure effective communication 
between heading impaired patients and their doctors. A DRA attorney observed, "Barriers to 


communication make it impossible for persons who are deaf or hard of hearing to undersfc 
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medical terminsdogy and procedures, difficult for such persons to participate in their,6wn health 
care, and make visiV for medical attention frightening and potentially life threateining." Similar 
cases, in which the U.S /Department of Justice was involved, resulted in substantial settlements 
by Middlesex Memorial Hosoital, Connecticut and the Main Medical Center. 

5 Equally, in the area of eoucation a significant need exists for/nhanced access by hearing 

disabled students. A number of lawsuits have already emerged based on the inability or 
unwillingness of educational institutions^ meet the requirement of "reasonable 

u accommodation." In a 1994 settlement resorting the firs/lawsuit filed by the Justice Department 

(St 

p under the ADA, the Becker CP. A. Review ("Be&er% an organization that prepares over 10,000 

ffi 

10 students annually to take the national certified puJ*li\accountant exam, agreed to amend its 

■ «. 

W auxiliary aids policy. If a need can be demonstrated, B^ker has agreed to provide qualified sign 
language interpreters and assistive listening devices to students who are deaf or hard of hearing. 
Similarly, under a consent decree, the company that runs Bar/Bri, the nation's largest review 


r l course for students taking the bar exam, agreed to provide qualifieclsign language interpreters, 


1 5 assistive listening devices, andfirailled materials to students with disabilities. The Department 
of Justice had alleged thatme course failed to provide appropriate auxiliary aids to students with 
vision and hearing impairments. Further, the company, Harcourt Brace, also agreed to pay 
S28,000 in compensatory damages, pay $25,000 in civil penalties to the United Spates, adopt a 
policy ensuriafg that auxiliary aids and services are provided, educate its staff about tite needs of 

20 studentswith disabilities, and promote the availability of auxiliary aids and services in il 
advertising. 
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Using U^S. Census data it can be seen that the incidence of hearing disabled stuflents in 
high school and in itigher education is growing slowly but steadily and it can be ejected to 
exceed 3,500,000 students by the year 2005. 


Hearing Impaired : Education Projections 
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Clearly the need for enhanced jeJommunication facilities for the hearing impaired extends 
across a wide spectrum of activities and institutions ranging from healthcare and education to the 
"Happiest Kingdom on Earthy The Department of Justice and Wak Disney World recently 
reached a comprehensive Agreement resolving complaints that Disney \ad failed to provide 
auxiliary aids for effective communication for persons who are deaf or harfl of hearing. Disney 
agreed to provide dral and sign language interpreters at numerous specified atbactions, make 
captioning systems available, provide transcripts to persons who are deaf or hard Shearing, 
provide closed captioning on video monitors, and provide assistive listening systemsVid written 


transcripts. 
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The system, known as Video Interpreting Program, has been offered by a well-established 
Maryland company, Sign Language Associates ("SLA"), since 1997. The system requires the 
use of a 3M™ VCS3 1 00 video conferencing system and 3 ISDN phone lines. According to SLA 
the Video Interpreting Program™ has been used in medical, legal and general employment 
environments. The service is billed by the minute. At least one problem with this service is 
cost and efficiency of labor. In this system, the interpreters must be in a specific location for set 
periods of time, specifically, at a provider site possessing the specialized videoconferencing 
equipment. This is cost and labor inefficient as, more likely, interpreters will not be needed and 
utilized consistently, but will be required to be available at the equipment location, thereby, 
restricting their ability to provide services elsewhere. 

In addition, voice recognition software has been developed. The Technology Assessment 
program ("TAP") of Gallaudet University, Washington D.C. (an internationally recognized 
education facility for the hearing impaired) is examining automatic speech recognition ("ASR") 
software, telecommunication relay services, captioning and wireless/cellular services. The 
current assessment of TAP is that voice recognition is making dramatic progress and while 
currently useable, does not suffer from "accuracy level, the problem of multiple voices and lack 
of clear speech" in terms of providing fully automated or live captioning. They do, however, 
note the ASR capabilities of Dragon Naturally Speaking and IBM Via Voice software. 

In addition, TAP is actively promoting "video chat" to the hearing impaired utilizing 
Microsoft NetMeeting in conjunction with the ATI All-in- Wonder VGA card. However, such 
"video chat" is designed for use among the hearing impaired and does not address the problems 
associated with providing an interpreter in one of the above-described situations. TAP makes no 
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reference to any commercial service seeking to use Internet video/audio as implemented by some 
of the various embodiments of the present invention. 

Also, telephone utility companies and the cellular telecommunications industry provide 
an extensive service to facilitate communications by the hearing impaired, particularly through 
the use of TTY and TDD systems. To date, however, there has not been a cost effective system 
introduced to satisfy the need for remote visual exchanges between an interpreter, a non-hearing 
impaired person and a hearing disabled person. Moreover, to date, there is no indication that any 
service providers has moved to implement a video/audio system based on Internet connections as. 
implemented by some of the various embodiments of the present invention 

Live interpreters are an integral part of communication for the hearing impaired and there 
is extensive network of these skilled professionals both nationally and globally. The Registry of 
Interpreters for the Deaf, founded in 1964, provides a national organizational structure, 
professional association and certification process for these interpreters and transliterators. It also 
embraces international membership. Although live interpreting is advantageous, it fails to 
resolve the basic problems presented herein, namely, providing an interpreter in a timely and 
cost efficient manner for various situations, such as, those, which arise in medical emergency 

* 

rooms and police stations. Live interpreting is, therefore, not seen as direct competition for the 

■ 

embodiments of the present invention. Various embodiments of the present invention may be 
utilized to fill a market gap - namely that of short-duration location-specific interpreting where 
both cost and time factors preclude the use of live interpreters. 

For example, in a hospital, it may take two hours or more to locate and transport a 
translator or interpreter to the medical facility so that the person may provide interpretation and 
translation, to, for example, a hearing impaired patient or family member of a patient. Thus, the 
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so-called golden hour is lost, because it takes, in this example, over twice as long just to begin 
questioning the patient in preparation for treatment. In a more typical conventional situation, at 
least a part of the golden hour may have been lost in transporting a patient to the hospital in 
preparation for treatment. Thus, the wait for a translator or interpreter to help either the patient 
or a family member becomes more imperative that it occurs quickly. For example, if only 10 
minutes of the golden hour is left that only allows for 10 minutes to track down and transporting 
the translator or interpreter or any other needed third parties to the hospital emergency room. 
This is often proven difficult if not impossible to accomplish in this time frame. 

In another scenario, as discussed above, a live interpreter might be located and provided 
via a teleconference system that may be set up, for example at an office specialty service 
provider, e.g., a Kinkos®. Unfortunately, having the interpreter being viewed at the local office 
specialty store rather than at the hospital really provides little, if any, ability to treat the patient 
or consult family members in an effective manner. Further, most hospitals do not have a 
significant telecommunications equipment for providing video conferencing at their facilities. 
However, for the hospitals that do have this equipment it is often located far away from the 
emergency room area and is considerably bulky and difficult, if not relatively impossible, to 
move from room to room. Thus, this solution of utilizing a hospital's teleconferencing 
equipment is also considered a failure to solve the above mentioned problems, such as medical 
facility interpretation, as the videoconference presentation of the interpreter is not in a useful 
location relative to the emergency room for the patient or the family that may be able to advise 
medical personnel in the treatment of the patient. 

In addition, to the inconvenience of the location of the necessary teleconferencing 
equipment, the cost is relatively high for the utilization of the equipment even if it is attempted 


-10- 


c 1 c ■ * ■ <. * c >• 

Attorney Docket No. 63015.801US01 

to be used. For example, teleconferencing equipment typically requires 3 ISDN lines to be able 
to receive an image on the teleconferencing equipment that provides the resolution and frame 
speed requisite to enable parties to the conference to be able to understand what an interpreter or 
translator is "saying." This is because the translator/interpreter is utilizing sign language that 
requires a visual perception of the translator on the teleconferencing equipment display. When 
the display and/or the speed in real-time appearance of the display is not adequate to see distinct 
precise and specific movements of the interpreter or translator, then.the communication is 
degraded and often becomes a complete failure in any attempt to communicate with the receiver 
of the display of the telecommunications equipment, The receiver may, for example, be the 
patient or a family member of the patient in the hospital. 

A need in the industry exists for a system, method and apparatus that provides an ability 
to locate and utilize an interpreter and/or translator quickly, for example, in real-time or in 
relatively near time, without having to maintain or provide a translator or interpreter to be 
constantly attending and personally present at a specific location of the user of the interpretation 
or translation services or efforts. Further, a need also exists for a system, method and apparatus 
that provides for utilization of these interpretive and/or translative providers via a network, for 
example the World Wide Web. Still further, a need also exists for a system, method and 
apparatus that provides for a multi-lingual interpretive or translative option that is available 
anywhere in the world in real-time or near real-time. 

Finally, a need exists for a system, method and apparatus for utilizing an interpretive 
and/or translative ability anywhere in the world by at least one of a user, recipient, and/or at least 
one third party that may also utilize a network, such as the World Wide Web, if desired in a 
relatively real-time or in near real-time utilization. 
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Summary of the Disclosure 

Embodiments of the present invention are best understood by examining the detailed 
description with reference to the drawings. However, a brief summary of the disclosure follows. 

Embodiments of the present invention comprises a system, method, and apparatus that 
provides for the utilization of a relatively real-time or near real-time interpretation or translation 
that may be utilized preferably for a relatively short duration of time, that is also preferably 
utilized with a network. A preferred embodiment of the present invention provides online, real- 
time, short-duration interpreting services in a network-based format. The service focuses 
directly on facilitating communication for the hearing disabled in situations which are highly 
location-specific and in which the use of live interpreters is neither cost nor time-effective or is 
otherwise inconvenient. 

The interpreting system comprises at least one provider computer, such as a server. The 
provider computer is capable of communicating with user computers via a network. In one 
preferred embodiment, the provider computer provides a series of web pages that allow access to 
the interpreting system, including, but not limited to, a request for service page, wherein a user 
can access the system and input a request for interpreting services. 

In preferred embodiments, the user, such as, a hospital, accesses the interpreting system 

i 

via a user computer, wherein the user computer is connected to a network. As discussed above, 
the interpreting system is accessed via a provider computer, wherein the user computer and the 
provider computer communicate via the network. 

Once the user accesses the interpreting system, the user provides information directed to 
the interpreting needs. This information includes, but is not limited to, time restrictions (when 
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the service is needed), subject matter of interpretation, anticipated length of service, age of 
hearing impaired person, and contact information. 

Upon receipt of the request for services, the interpreting service sends out a request to all 
available interpreters. Any available and qualified interpreter that is qualified for the type of 
interpretation required, accesses the interpreting system and identifies himself or herself as 
available. An interpreter is then chosen. The chosen interpreter contacts the user via the 
network and performs the required services. 

In a preferred embodiment of the present invention, the user, such as a hearing impaired 
person or third party, does not pay the interpreter directly, but rather, pays, for example, a 
monthly fee. In some preferred embodiments, the user pay a monthly fee for either a limited or 
unlimited amount of access and use of the interpreting system. Further, an entity, for example, a 
hospital may pay a monthly fee for the right to utilize the interpreting system in treatment of its 
patients and communication with others that may assist the hospital in treatment of its patients. 

In addition to monthly fees, in alternative embodiments, the user can pay based upon a 
variety of factors, including, but not limited to, a per session fee, a per translation fee, a fee 
based on the number of words or data translated per use, the type of interpretation provided, the 
quality and/or certification of the interpreter, the relative cost of the linking of various parties 
and interpreters to the network, the availability and time of day, and whether a preference was 
indicated by the user for a particular translator or qualification of translator, and the physical 
location of the interpreter or other parties to the session. Alternatively, the user may also pay 
based upon the cost of the transmission links, or a percentage of the cost of either a portion or all 
of the translation and/or interpretation direct or indirect costs. Also, the fee may be based upon a 
licensing or other type of intellectual property payment scheme such as a per translation or per 
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transaction or session cost or based upon the percentage of time utilized for translation versus 
other portions of the communication session and/or any other method or allocation or charge or 
costs that the user may so desire and/or the provider may wish to provide. 

Brief Description of the Drawings 

Embodiments of the present invention are described in detail herein with reference to the 

drawing in which: 

Figure 1 illustrates a portion of a first embodiment of a virtual Internet drive method and 
device, in accordance with the principles of an embodiment of the present invention. 

Figure 2 depicts a preferred embodiment of the present invention during use. 

Figure 3 depicts a preferred embodiment of a hand held two user computer device, 
wherein the two user computers are housed within a single housing. 

Figure 4 depicts a side perspective of the embodiment shown in Figure 3. 

Figure 5 depicts usage of the embodiment shown in Figure 3 by two users. 

Figure 6 depicting use of the two user computer device utilized by a two separate users 
each having a separate two user computer device. 

The accompanying drawing, wherein like numerals denote like elements, are 
incorporated into and constitute a part of the specification, and illustrate presently preferred 
exemplary embodiments of the invention. However, it is understood that the drawing is for the 
purpose of illustration only, and is not intended as a definition of the limits of the invention. 
Thus, the drawing, together with the general description given above, the detailed description of 
the preferred embodiments given below serves to explain the principles of the invention. 
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Detailed Description of the Preferred Embodiments 

An embodiment of the present invention is illustrated utilizing functional flow charts as 

illustrated in Figures 1 . The present invention may be implemented on any computer that has 

« 

access to a network, e.g., the World Wide Web, as well as hand-held devices such as personal 
communication devices, including, but not limited to portable telephones, personal appointment 
managers, a Palm Pilot, and other Internet access devices such as Web TV. A network access 
itself may be achieved by radio frequency link, telephone modem, cable modem, high-speed 
DSL, wireless connection or any other network communication technique conventionally 
available. 

As the World Wide Web access is improved, such that the speeds between the user and 
the World Wide Web are increased so that the user may download and upload data more quickly, 
the user may continue to enjoy an ever-increasing benefit from the utilization of various 
embodiments of the present invention, as compared to conventional techniques. 

Preferred embodiments of the present invention are directed to a system, method, and 
apparatus for providing relatively real-time or near real-time interpretation, wherein the need for 
interpretation is a relatively short amount of time. In preferred embodiments, the interpretive 
system is provided via a network. For example, in one embodiment, communication may be 
facilitated for the hearing disabled in situations that are highly location specific, such as, a 
hospital, police station, car rental counter, or retail store in which the utilization of live 
interpreters is neither cost nor time-effective. 

In preferred embodiments, the interpreting system comprises at least one provider 
computer, such as a server. The provider computer is capable of communicating with user 
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computers via a network. In one preferred embodiment, the provider computer providers one or 
a series of web pages that allows access to the interpreting system, including, but not limited to, 
a request for service page, wherein a user can access the system and input a request for 
interpreting services. 

The provider computer is accessible to a plurality of interpreters via individual computers 
capable of communicating with a network, or any other means of accessing the network, such as 
a palm pilot, upon which interpreting services may be displayed in real time or near real time. A 
subset of the plurality of interpreters make themselves available via the network, or any other 
communications means, such as, a telephone, pursuant to a predefined schedule. In preferred 
embodiments, an interpreter is available throughout the network, regardless of user geographical 
location, 24 hours a day, 7 days a week. In preferred embodiments, an interpreter may become 
available to the system not pursuant to a predefined schedule, but at the time or times the 
interpreter desires to make his or her services available via the network. 

In preferred embodiments, the user, such as, a physician or aide in a hospital, accesses 
the interpreting system via a user computer, wherein the user computer is connected to a 
network. As discussed above, the interpreting system is accessed via a provider computer, 
wherein the user computer and the provider computer communicate via the network. 

Once the user accesses the interpreting system, the user accesses the interpreting 
service's request web page, customer service or scheduling department, or other appropriate live 
or digital representative of the interpreting service and provides information directed to the 
interpreting needs required. In some preferred embodiments, the user may request the first 
available interpreter. In other preferred embodiments, the user may provide a plurality of other 
specific requests and other data to assist in matching the user's interpretation requirements. This 
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information includes, but is not limited to, time restrictions for the providing of the service 
(when the service is needed), acceptable price or price range of interpreter, the requirement of 
acceptance of the user's insurance to cover all or part of the services to be provided, subject 
matter specialty of interpretation (legal, medical, diplomatic and/or technical areas), legal or 
organizational certification of interpreter, one or more specific foreign languages required for 
interpretation, anticipated length of service required, preferred gender of interpreter, age of 
hearing impaired person (e.g., if a child communication specialist is required), parental consent 
(if hearing impaired person is a minor) geographic proximity of the interpreter to the user, 
previous evaluations, ratings or recommendations of the interpreter, previous use of the 
interpreter by the user, request for a particular interpreter, request to include advertising, request 
to exclude advertising, and other criteria, and user contact and payment information, including 
promotional participation data. In some preferred embodiments, the user fills in a series of data 
boxes online to transmit the aforementioned data. In still other preferred embodiments, the user 
is provided with a pull-down menu that allows for users to choose from a variety of predefined 
menu options, wherein the options define the type of service request desired. Once the user has 
filled in the request page, or otherwise provided information regarding the type of service 
requested, the user submits and transmits the information to the provider computer, 
representative person, department or digital agent. In some preferred embodiments, the ( 
aforementioned request is performed telephonically. In still other preferred embodiments the 
aforementioned request is performed via audiovideophonic communication. In still other 
preferred embodiments the aforementioned request is directed to providing an interpreter which 
may be geographically proximate to the user so as to enable the interpreter to effectively 
translocate to the place where interpretation services are needed for further or extended on site 
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interpretation services. In still further preferred embodiments, the request is directed to an 
interpreter capable of providing interpreting services en route to the location of the user as by 
mobile wireless connection to a network. 

Upon receipt of the request for services, the interpreting service matches the criteria for 

* 

the interpreter requested and effectuates an audio videographic connection between the 
interpreter and the user. In preferred embodiments, the interpreting service transmits a request to 
all available interpreters. Any available and qualified interpreter, that is, qualified for the type of 
interpretation required, accesses the interpreting system if not on-line, and identifies themselves 
as available. An interpreter is then chosen. The chosen interpreter contacts the user via the 
network and performs the required services. In other preferred embodiments, the interpreting 
service effectuates a connection between an "on call" or predesignated interpreter and the user 
requesting the services. 

The above-described system is capable of being used in virtually any type of institution, 
retail establishment, organization or individual home. Indeed, in some instances, some of the 
hardware already exists. For instance, healthcare institutions already possess good computer 
facilities located in service transaction areas such as emergency rooms and outpatient clinics. 
Thus, unlike existing video conferencing services, no new equipment is required for at least 
some of the embodiments of the present invention. Moreover, healthcare facilities are already 
familiar with the use of Web-based technology to enable remote consultations such as radiology. 
Thus, no substantial behavior modification is required of the customer. 

A preferred embodiment may be utilized on similar public sector and commercial 
institutions that meet similar market criteria: the requirement to meet the ADA "reasonable 
accommodation" standard, have existing computer facilities located in or adjacent to public 
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interface or service areas. This may, e.g., include Police and Paramedic agencies, Social 
Security, Immigration, Police, Courts, and Department of Motor Vehicles as well as commercial 
applications such as airports, rental car companies, amusement parks, banks and department 
stores. Similarly, the educational market offers downstream potential with continued 
development of automatic voice recognition captioning for longer duration simultaneous 
translation. 

Yet another embodiment may be utilized for individual home subscribers. This would 
permit hearing disabled individuals to facilitate communication with family, friends and other 
contacts thereby enhancing their quality of life. In addition, it would enable these subscribers to 
undertake regular calls and daily contacts with emergency services, doctors, utility companies, 
etc. 

In some preferred embodiments of the invention, third party vendors of goods and 
services utilize the interpretation services to provide sign language advertisements, 
introductions, information and education regarding their goods and services to the 
aforementioned subscribers. In still further embodiments, fourth party agents and affiliates may 
use the interpreting system to perform such advertising, introduction, information and education 
services in exchange for consideration, including, a fee for any goods or services purchased by 
the user. 

Yet another embodiment may be utilized, that incorporates global application for its 
hearing impaired interpreting concept with flow-on implementation to offer multilingual, foreign 
language interpreting for its core customer base. 

The online, real-time interpreting service developed in various exemplary embodiments 
for the hearing disabled directly targets this market by taking advantage of a clearly identified 
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need, an established legislative imperative in the form of the Americans With Disabilities Act 
and the emerging technology which now allows networked real-time imaging via the Internet. As 
outlined in the following section, preferred embodiments that may provide healthcare and 
education sectors with rapid expansion envisaged into those areas of commerce which involve 
substantial person-to-person interface such as amusement parks; airports - including information 
booths, ticket counters, customs and immigration facilities; rental car companies; and major 
shopping malls. It is noted that the existing Internal Revenue Code (Title 26, Section 190) allows 
tax deductions of up to $1 5,000 annually for the removal of barriers to people with disabilities. 

Hearing impairment is not a disability peculiar to the United States and hence the 
opportunity exists to establish yet other arrangements of the present invention on a global basis 
through a multinational network of qualified interpreters linked by the Internet or other wide are 
computer networks. Preferred embodiments of the present invention are capable of operating on 
a global basis through a multinational network of qualified interpreters linked by one or more 
common networks. In some preferred embodiments, the interpreting system provides real-time 
simultaneous language translation in a location-specific manner worldwide. The service for 
hearing impaired is in itself a significant, however, the possibility of simultaneous language 
translation via the Internet or other wide area networks, can provide the facilitation of 
communication in a wide array of services and situations. 

In the travel industry this "point-of-sale" service may be utilized by airlines, rental car 
operations, hotels, cruise operators and the like. It has direct application for point-of-entry 
interpreting for immigration desks, customs officials and transport operators. In the education 
sector it suggests the possibility of online education beamed globally yet available 
simultaneously in a number of different language translations. In business it has future potential 
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for allowing global executives to utilize their own, trusted sources for interpreting and avoids the 
necessity to rely on host country interpreters who may be unfamiliar with the technical terms 
being used, unfamiliar with the business or negotiating style of the executive and who may pose 
a significant industrial espionage threat. 

Preferred embodiments of the present invention may be implemented in a rapid, albeit 
preferably sequenced, expansion into this area based on the establishment of a global exchange 
linking established interpreting and translation services world wide in a real-time online 
network. 

Preferred embodiments provide an online real-time short duration location specific 
interpreting service geared initially to the needs of the hearing disabled in the United States but 
with subsequent second stage expansion to enable coverage of key global markets. It is 
envisaged that the third stage of expansion would move beyond the hearing impaired to embrace 
real-time simultaneous language translation in a multilingual and multinational-networked 
format. The service will be capable of operating on both a point-to-point and a multi- 
conferencing basis as necessary. The integrated use of voice recognition is planned for ongoing 
development and implementation of the service. 

At present, the hearing needs of the hearing disabled are catered for by the use of such 
instruments as assistive hearing devices, paging devices, telephonic devices including TTY and 
TDD, pictograms and both sign language and oral interpreters. All these instruments ameliorate 
the barriers faced by the hearing disabled. Moreover, all these instruments are classified under 
the Americans With Disabilities Act as "auxiliary aids and devices" recognized as meeting the 
"reasonable accommodation" prescription of the Act. However, in certain key circumstances 
these "aids and devices" have significant drawbacks. For example, the provision of qualified 
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sign language or oral interpreters must often be arranged up to two weeks in advance and in 
emergency or life threatening situations there can be both unacceptable delay and excessive cost 
in obtaining interpreters. 

In one preferred embodiment, the present invention provides for the introduction of an 
online exchange linking a network of qualified sign language interpreters, oral interpreters, 
simultaneous transcribers and, where appropriate, voice or motion recognition captioning. The 
exchange would utilize current Internet and wide area computer network technologies allowing 

live audio and video feeds. 

Arrangements of the present invention may also be utilized or, e.g., integrated with, e.g., 
Real Networks, CUSeeMe, Net Meeting and other software solutions that facilitate worldwide 
video and audio communication and data collaboration across the Internet. In addition, the 
potential use of the emerging Bluetooth chip technology would allow remote wireless 
communication in local networks, for example within emergency rooms and hospital wards, thus 
allowing mobility on the part of the user such as required by an emergency room physician in an 
examination room. These are situations where short-term interpreting is required (short-term 
generally being of periods less than approximately 30 minutes but may be even less, e.g., 25, 20, 
15, 10, 5, or even less than 1-5 minutes in a location-specific or transaction-specific environment 
and for which the use of a physically present interpreter is neither cost nor time effective. 

In reference to a preferred embodiment in Figure 2, the network could operate as follows 
in, for example, the case of an emergency room physician treating a hearing disabled patient: 
• Utilizing a PDA, laptop, Internet-capable cellular phone, or similar handheld device, 
capable of receiving, displaying and broadcasting the remote sign language or foreign 
language interpreter's signing and vocal communications, such as by flat screen monitor 
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and speaker, and capturing and transmitting the hearing impaired person's signing, and the 
physician's voice, such as by camera and microphone devices, the physician would log on 
to the network via the hospital internet service connection; 

• The present invention's menu would provide a choice of icons for interpreting services, 
e.g., labeled in both script and pictogram; 

• The physician user would choose the type of service, price, interpreter qualifications, time 
to commence the services, and any other user selectable request criteria; 

• A user, e.g. , a physician would click to the required icon for connection; 

• Service would search the network and connect to the first available interpreter; 

• Audio and video connection would be established and interpretation would then begin 
utilizing voice communication between the physician and the interpreter and sign language 
between the sign language speaking hearing impaired patient; 

• As necessary, required or requested, communications by one or more of the parties can be 
made available in scrolled text on the screen generated by real time stenographic or voice 
recognition means. 

• The interpreting transaction would be recorded in file format for playback as necessary for 
checking accuracy or in the event of liability or dispute. 

In some preferred embodiments, the user of the service is a subscriber to 
the service 

wherein access to the service is password protected. In some preferred embodiments, the user 
pays a monthly service fee to have access to interpreters and, pays a fee to the 
interpreting service for actual use of the interpreter on a fee for time basis. 
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In some preferred embodiments, the user pays for the services on an "as needed" basis 
wherein access to the service is preceded by the presentation, authorization and acceptance of a 
credit card, debit card, digitally signed contract or other payment means. 

In some preferred embodiments, the interpreter(s) is (are) directly paid for all or some 
of sums due to the interpreter(s) by the aforementioned "as needed" payment is made by the 
user. 

The exchange would link participating sign language or oral interpreters regardless of 
the interpreter's physical location. In preferred embodiments, interpreters would be 
available on a twenty-four hour basis for all users, wherever located, despite the potential time 
zone differentials that may arise. 

In some preferred embodiments, participating interpreters would be required to meet 
specified participation criteria, such as certification from the appropriate U.S. certifying body or 
bodies (e.g. Registry for Interpreters for the Deaf). Membership of the exchange would be 
subject to a controlled application process and would entail, e.g., an annual membership fee. In 
addition, participating interpreters must have access to computer equipment meeting predefined 
specifications or be required to lease such equipment from the provider or utilizer. Each 
participating interpreter would be required to cany a specified level of public liability insurance 

over and above that carried by provider or utilizer. 

In preferred embodiments of the invention, look-up and verification of a selected 
interpreter's insurance status (e.g., to determine if the required policy is valid and in force) by 
access to an appropriate insurance data base or by other means, may precede the connection of 
the user with the interpreter, and if the results of such look-up reveals that the interpreter is 
uninsured, underinsured or that there is some other liability concern, the interpreter could be then 
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made unavailable for to provide the requested services. 

A provider or utilizer portal may be located with an existing major service provider, who 
will be offered exclusive rights to host the service for a fixed contract period. This provider will 
be given first right of refusal for the subsequent envisaged expansion of the provider or utilizer 
platform, i.e. the second stage development into providing hearing impaired coverage for 
selected global markets followed by a third stage expansion into providing simultaneous 
translation on a multilingual and multinational basis. 

Targeted institutions will be offered a service subscriber package entailing an annual 
subscription rate covering a guaranteed amount of time on the service per month. In the manner 
of telephone calling cards subscribers will be able to "top up" their monthly subscriber time 
allocation should they appear close to exceeding their normal subscription rate. Member 
institutions will be designated as "The Provider or Utilizer Service Members" and their contact 
details circulated in directory form to the hearing disabled across the United States. Signs 
bearing the provider or utilizer logo will be supplied to member institutions for display in public 
areas thus promoting the institution's use of the provider or utilizer Service. In addition health 
insurers will be encouraged to provide priority coverage for insured health impaired patients to 
seek treatment at "Provider or Utilizer Service Member" institutions and clinics. 

The provider or utilizer may also enable, because of the above, create a large secondary 

■ 

market for hearing disabled individuals to seek personal subscriptions to The Provider or Utilizer 
Service. Such individuals would be able to log into the service from a home or office computer 
and utilize the video service to communicate freely with friends, relatives and business 
associates. In addition, personal subscribers can use the interpreting service to facilitate the 
regular telephone calls and daily contacts that the hearing enabled take for granted. This would 
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include emergency calls, calls to healthcare professionals to seek appointments or prescription 
refills, calls to government agencies such as IRS and Social Security, calls to utility companies 
and calls to taxi services, airlines and the like. Again personal subscribers would purchase a 
monthly access package with the capability to "top up" on a month-to-month basis should their 
circumstances so demand. The ability for hearing impaired individuals to have access to such a 
service not only offers considerable potential to improve their quality of life but also offers a 
vehicle for increased independence and personal confidence. 

As previously described, the substantial number of Americans classified as having 


chronic hearing impairment, an estimated 23,000,000 in the year 2000. This represents a 

ljij substantive market for a wide range of goods and services that can be exclusively promoted to 

SJ 

this target audience via the personal subscription to the Provider or Utilizer Service. Access to 


this market (a market that is in large part unreachable by existing vehicles such as telemarketing, 


p radio and television that rely on audio delivery) via the use of the Provider or Utilizer Service 


U1 enables third party vendors to use preferred embodiments of the instant invention to provide a 


1*5' useful promotional vehicle for a large number of goods and services. 

In turn, the establishment of a core membership of subscriber healthcare institutions then 
provides the platform for expansion of the service to other institutional target sectors who - like 
the healthcare industry - are subject to the "reasonable accommodation" standard of the 
Americans with Disabilities Act, have high levels of public interface and who have existing 
20 computer facilities (preferably with broadband access) already located in or adjacent to public 
interface areas such as service desks. Such targets will include government agencies such as 
Social Security offices, Immigration & Naturalization Service, Public Housing agencies, Courts, 
Police Departments, Department of Motor Vehicles and Inland Revenue Service. Flow-on target 
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subscribers that meet the above criteria would then include more commercial applications such 
as airport information desks, airline lounges, rental car companies, hotels, amusement parks, 
supermarkets, drug stores and department stores. Again, all these target sectors have a 
requirement for short duration interpreting of customer interactions taking place at the point of 
service transaction. These are all situations where, in the absence of a services such as the 
Provider or U preferably offers, there is considerable potential for confusion, frustration, 
discrimination and the inevitable deterioration of customer service. In addition, with a potential 
target audience amounting to some 8% of the American population there is a clear commercial 
incentive for such private sector outlets to become subscribers and to be aggressively promoted 
to the hearing disabled as offering this service - particularly in view of the tax credits which 
apply (see Appendix 1). 

Similarly, the educational market is seen as a substantial market opportunity, particularly 
in association with online education providers or in classrooms offering a standardized, 
repeatable lesson format, e.g., technical training where the need is not for short duration, time 
sensitive interpretation but can be delivered in a prepackaged, repeatable format thus offsetting 
the current cost of delivering real-time interpreting. Real-time interpreting of, for example, a 3 to 
4 hour graduate class would be prohibitively expensive for most educational facilities. However, 
educational facilities increasingly have high levels of computer technology installed or available 
for in-class access by students. Also, the provider or utilizer may also incorporate or utilize voice 
recognition, so that it will be able to offer in the short-term a future a cost-effective closed 
captioning service via the Internet or wireless device that would enable hearing impaired . 
students to effectively and unobtrusively participate in the class utilizing a voice recognition 
caption stream on the student's laptop device. 

-27- 


* » ? » ♦ • , • I • 

Attorney Docket No. 63015.801US01 

In a business method arrangement of various embodiments of the above-described 
invention, a subscription may be utilized. Thus, a fee may be paid, for example, at a regularly 
set time, for example, every month in order to be provided with and/or utilized and/or obtain 
translation and/or interpretation up to a certain time limit or may even be unlimited depending 
upon the subscription price. This would particularly be beneficial too, for example, police 
departments, hospitals and the like and other community service organizations because this 
would provide for essentially a fixed fee amount that can be more readily budgeted by these 
organizations and thus provide a more cost effective and cost conscious provision of services for 

« 

the hearing impaired by these organizations. Further, it will allow these organizations to more 
accurately predict their budgets so that they may provide the best utilization of their often 
limited funds for services including providing for access to at least some of the various 
arrangements and embodiments that comprise the present invention. 

In yet another alternate embodiment of the present invention, a portion or all of the 
translation or interpretation including but not limited to any of the arrangements that are 
described below with reference to Figure 1, there may also be provided with a reduced fee or 
even a free Internet service provider account such as a free DSL account. Alternatively, and/or 
in conjunction with the free DSL account, other arrangements and preferred embodiments of the 
present invention may be provided with a type of advertising such as Web-based banner, audio, 
visual, audiovideo and/or multimedia "commercials" or other advertising or surveys that may be 
presented and/or interacted with by the user and/or interpreter(s) at any time before, during 
and/or after the translation or interpretation is being provided. In other preferred embodiments, 
such advertisements may alternatively be implemented so that said advertisements are displayed 
when there is, for example, silence for a certain amount of time or the user indicates that it is a 
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non-critical communication and that information such as advertisements may be allowed in 
addition to the translation and/or interpretation being utilized. In still other preferred 
embodiments, such advertising may exist in a user opt-in or opt-out configuration. In still other 
preferred embodiments, the presence or absence of such advertising may be associated with 
increases or decreases in the price to the user for providing the interpreting services and/or the 
payment to the interpreter(s) for providing the interpretation or translation service. 

The various arrangements and embodiments of the present invention may also be utilized 
with the above and/or with a provision for a relatively reduced fee and/or free long distance 
communication configuration or enablement option for the user, for example, by utilizing the 
World Wide Web to transmit other types of communications such as voice while also utilizing 
the translation and/or interpretation for a hearing impaired person. 

In yet other alternate arrangements and embodiments of the present invention, the 
system, method and apparatus may engage interpreters that are transported in person to a 
specified location, for example, a police station or hospital emergency room, or in a preferred 
arrangement, by providing the interpretation or translation to the subscriber and/or to the user or 
any other third party via a network, for example, the World Wide Web en route to the specified 
location. 

In yet other alternate arrangements and embodiments of the present invention, the above 
subscription business method may be utilized with present interpreters that show up or are 
transported in person to the various locations where such services are requested, for example, 
police stations or hospital emergency rooms, or in a preferred arrangement by providing the 
interpretation or translation personnel to the subscriber and/or to the user or any other third party 
via a network, for example, the World Wide Web. 


-29- 


I I 

Attorney Docket No. 63015. 801US01 

In the various alternate arrangements and embodiments that utilize as a portion of the 
communications network, there are many further arrangements and embodiments that may be 
understood in the practice of this invention. First, for example, a subscriber or utilizer may 
utilize the network to connect with a boiler room of interpreters that are on standby and ready to 
immediately interpret for a subscriber when contacted. Alternately, the interpreter or a number 
of interpreters may be, for example, home based or offsite location-based and may be utilized as 
an overflow to the boiler room or vice versa where the preferred interpreter is home based and 
the overflow of requests, when the supply of home based interpreters is exceed is handled by a 
boiler room of interpreters. Of course, an essentially boiler room may be created by linking a 
plurality of home based or other offsite based interpreters. In preferred embodiments of the 
invention dynamic allocation of interpreters on the basis of availability and demand is 
accomplished either automatically by the service's network software or by one or more human 
dispatchers. 

In yet another alternate arrangement of the present invention, the interpreters may instead 
be located by the subscriber or a third party by utilizing a wireless technology, for example, a 
mobile phone that indicates to the interpreter to contact through preferably a specific website 
address the subscriber and begin interpretation. Interpretation may be provided visually, for 
example, by utilizing the mobile phone in connection with a laptop and a small CCD camera 
mounted with a laptop or separately so that the interpreter may immediately provide services 
anywhere in the world. In addition, the interpreter may also at the same time obtain or be 

■ 

automatically provided transportation, for example, by the hospital or via other third parties or 
by the interpreter themselves hailing a taxi, for example, and being transported while continuing 
to interpret in a wireless embodiment of the present invention. 
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In yet other alternate arrangements of the present invention and particularly in a plurality 
of preferred arrangements that utilize a wireless portion may thus provide worldwide coverage. 
Also, multi-lingual coverage may be provided, for example, a Spanish speaking hearing 
impaired person may utilize a Spanish speaking interpreter that is actually located in Spain when 
there are no Spanish interpreters remaining more near by relative to the hearing impaired person. 
Or vice versa, the Spanish speaking hearing impaired person may actually be in Spain and wish 
to utilize a specific facility such as a renowned hospital and an interpreter that speaks both 
English and Spanish that may, for example, reside in the USA and thus obtain the desired 
translation and interpretation by utilizing yet another arrangement of the present invention 
preferably in a network environment. 

In yet other alternate arrangements of the present invention, the linkage between, for 
example, the interpreter and the hearing impaired person may be predetermined or may be 
implemented in real-time depending upon input from any one of the interpreter, the hearing 
impaired person, and/or any other third party or a combination thereof. Thus, in one exemplary 
embodiment of the present invention, the hearing impaired person may indicate a preference for 
a specific interpreter such as one that has been utilized previously by the same person and the 
hearing impaired person wishes to utilize the same interpreter again. The routing between the 
parties may also be accomplished by other at least partially predetermined and/or real-time 
decisions based upon software algorithms that include choosing the routing based upon the 
physical location of the interpreter, the hearing impaired person, and/or any other third party, on 
the previously described preference of one or more of the parties, based upon the cost of 
interpretation and/or connection, based upon the availability of any one of the parties involved, 
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and/or based upon the skill level, and/or whether or not the interpreter is state and/or government 
approved or certified and the like. 

Further, other changes to the routing may include rating and/or acknowledgment of any 
specialized knowledge on a specific subject that the interpreter or any other third parties have or 
a rating based upon past performance may also be utilized or incorporated with the other factors 
in deciding the routing to be utilized. Again, this selection may be via a predetermined 
algorithm, a third party that is monitoring and/or even arbitrarily deciding the routing between 
the hearing impaired person and any other party, and/or may be determined solely by any one of 
parties including the hearing impaired person themselves. 

In a business method application of various embodiments of the present invention, there 
may be a cost difference to the user and/or any other third party depending upon the skill level 
and/or experience in communicating that the interpreter has. Also, a menu may be provided to 
any of the connected parties, for example, the interpreter, the hearing impaired person, and/or 
any other third party that may be utilized to select or indicate a preference, for example, a 
certified or licensed interpreter and/or any of the other above-mentioned preferences as desired. 
Depending upon these choices may indicate an instantaneous change in cost in real-time or near 
real-time for the continuing interpretation being provided. Thus, as a higher skill level is desired 
a different interpreter may be provided, for example, for a few minutes and then the hearing 
impaired person may shift back to a first or even a third interpreter that is provided a lower rate, 
for example, in more calm family discussions as opposed to when a higher priced interpreter 
may be desired that may be familiar, for example, with complex medical terminology and the 
like in evaluating treatment with a doctor. 
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Other arrangements for providing a charge include a charge or fee by subscription, for 
example, a fixed cost per month, or maybe utilized with a Visa or MasterCard or other credit 
card that preferably utilizes a chip in the card so that a more informed knowledge of any of the 
connected parties maybe instantly ascertained, at least in part, by utilizing information contained 
in the chip on the charge card or other identity or informational card being utilized in connection 
with the various embodiments of the present invention. 

Yet other embodiments may utilize a fixed fee for a base number of minutes or time 
period amount or have a cost associated with the excess units of time that are utilized. For 
example, charging an extra $2.00 a minute for any utilization over 30 minutes a month. Other 
cost ranges may include, for example, other services that may be provided along with the visual 
interpretation, such as, a real-time transcript or a transcript that is provided at a later date, a 
video tape, and/or audio that may be analog or digitally or any other technique as is known in the 
art to record and preserve the interpretation activity. 

Thus, various embodiments of the present invention may also be utilized to generate live 
or real-time transcripts, as well as a recordation of any or all of the communications and/or 
interactions of any of the parties. 

Some of the parties are illustrated in Figure 1 and may be involved in the utilization of 
various embodiments of the present invention. 

In Figure 1, a network 10 is utilized to provide a communication or a connection between 
any combination or arrangement of at least one or more of a hearing impaired person ("HIP") 12, 
a monitor ("M") 14, a teacher ("T") 16, an interpreter ("I") 18, and/or any other third party ("O") 
20. The connections are quasi connections between any of the parties 12, 14, 16, 18, 20 and the 

» 
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network 10 may be accomplished by any technique known in the art, for example, wireless 
connections, land-based connections, satellite connections, and/or any combination and the like. 

More specifically as shown in Figure 1, the HEP 12 is a utilizer of the translation or 
interpretation of this exemplary arrangement of the present invention and may also be, for 
example, a family member or other close associate of the user or any other person the user may 

■ 

designate. The M 14 of the network 10 is preferably utilizing this exemplary embodiment of the 
present invention in order to, for example, monitor, measure, rate, or otherwise provide a type of 
quality control, evaluation, or insurance of an appropriate level of quality or service by the 
interpreter. The monitor may also provide the above evaluations as described for the T 16 and/or 
any O 20 and even if desired for the HIP 12, if desired. In fact, a cost attribution or 
implementation of a business method implementation of the present invention may also include a 
rating or other evaluation of the hearing impaired person themselves to adjust the price based 
upon economic class or level, government assistance available, and/or tax credits, or may even 
be based upon the relative skill of the hearing impaired person and the price adjusted accordingly 
based upon the ability of the hearing impaired person to utilize the embodiment of the present 
invention in a satisfactory or efficient manner. 

The T 16 is preferably utilizing this exemplary embodiment of the present invention in 
order to teach the hearing impaired person wherein the teacher needs that interpretation or 
translation in order to perform the teaching exercise with the hearing impaired person. Of 
course, it is understood that the teaching exercise need not be related in any way to sign 
language or the hearing impaired activities but instead may be any teaching situation, for 
example, teaching mathematics, art, or any other subject as desired by any of the parties. 
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The 118 may include, without limitation, a translator and/or transliterator or any other 
aid or assistant or similar type of interpreter that may be utilized for any person needing such 
help, preferably those understood to fall under the American With Disabilities Act. 

Finally, the O 20 may comprise, for example, police, hospital's administration and staff, 
doctors, relatives that are not at the hospital but wish to sit in on the consultation with the 
hearing impaired patient, and/or additional hearing impaired family members that may also wish 
to utilize and be aware of the communication transpiring between the hearing impaired person 
and any other person or entity that is connected via the network in this exemplary embodiment 
of the present invention. 

♦ 

Yet another arrangement of the present invention may include providing the 
interpretation on a time delay basis, for example, where the delivery of the interpretation is at a 
point in time substantially after the provision of the speech and/or sign language to be interpreted 
and translated. Thus, for example, in one exemplary embodiment a person may speak into a 
recording device and then at some later time, for example, 12 hours later, the recording may be 
transliterated and then provided as desired to the hearing impaired person at a convenient time 
that they request. Also, the initiator or verbal message user in this example may specify time for 
delivery of the translated communication. Of course, it is understood that yet another 
arrangement of the present invention includes a video tape or a recordation of the visual sign 
language by the hearing impaired person that has been transmitted through a translator and the, 
for example, spoken interpretation is then later delivered, for example, as a voicemail to the 
intended recipient. Similarly, any transcripts or recordations or the like may also be provided at 
a time delay and the cost of the same in the use alternate embodiments may be adjusted 
accordingly, if desired. 
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In yet other arrangements of the present invention in an exemplary embodiment a 
synthespian arrangement may be utilized, wherein a synthespian is a digitally generated 
interactive actor, avatar, agent or a digitally morphed, modified or enhanced interactive 
recording of a real person. Thus, for example, a hearing impaired person may utilize a network 
to communicate with a receiver or an interpreter or a recorder that may be later viewed by the 
interpreter. The interpreter may then interpret the sign language communication into the spoken 
language, and provide it to, for example, a third party. However, this example prior to the 
viewing by the interpreter of the hearing impaired person's communication via sign language, a 
computer generated synthespian may, for example, be utilized to mask or alter the appearance of 
the hearing impaired person so that the interpreter will not know the true identity of the hearing 
impaired person in order to better safeguard and provide a semblance of privacy for the hearing 
impaired person. Alternatively, in a similar fashion the interpreter may receive a spoken 
communication and translate it into sign language for the hearing impaired person. However, 
prior to viewing of the interpretation by the hearing impaired person, the visual image is passed 
through, for example, a computer processing unit that then converts at least a portion of the 
image of the interpreter into a synthespian type image. Thus, the hearing impaired person only 
sees an artificial or synthespian interpreter and not the actual physical look and/or identity of the 
interpreter so that the deaf person and/or the interpreter may be provided with a relatively secure 
and/or a relatively private type of communication. Thus, the hearing impaired person may later 
"bump" into the interpreter on the street and yet neither would recognize the other, thus, 
providing some semblance of privacy for the hearing impaired person and/or the interpreter 
and/or any other third parties. 
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In preferred embodiments of the instant invention, the aforementioned synthespian 
substitution or "masking" of the identities may be applied to the hearing impaired user, the 
interpreter, any third party users, such a physician using the service in an emergency room 

* 

and/or any remote third party participant in the videoconference. In further preferred 
embodiments, the synthespian substitution or masking of identities may by performed in real 
time by sufficiently fast processing of digital data corresponding to the images and voices of the 
aforementioned parties. 

Yet other alternate embodiments of the present invention include utilizing the 
interpretation over the network as a portion of, for example, a video dating service, wherein the 


Vm translator and/or interpreter may be provided in relatively real-time to assist a hearing impaired 

'I 


person in a World Wide Web based dating service and the like. Similarly the various 
embodiments of the present invention may be utilized so as to conduct an adult video 


h conferencing communication wherein the communication is primarily of a sexual nature. 


HI Further, a video chat room or a chat room that is provided with a video link to the hearing 

o 

IS* impaired person may utilize, for example, streaming video to enhance the communications via 
the interpreter at a World Wide Web chat room. Thus, the hearing impaired person may make 
arrangements to "meet" at a specified time on a website chat room wherein the hearing impaired 
person utilizes various aspects of the present invention to have the hearing impaired person's 
communication be translated into verbal or spoken communication and vice versa from the other 

20 parties participating in the chat room activity. This may be done either in a time delay fashion as 
described above that is a message to the chat room or alternatively in a relatively real-time or 
near real-time application in yet another embodiment of the present invention. It is particularly 
applicable for utilizing various embodiments of the present invention in the more recently 
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implemented video chat rooms that may be engaged in the utilization of a network such as the 
World Wide Web. 

In further embodiments of the instant invention, the providing of interpreting services 
using the system, method and apparatus disclosed herein includes the provider's, user's and/or 
subscriber's use of tax incentives, such as tax credits as set forth in Appendix 1 hereto, provided 
by one or more governmental entities for the purchase, installation, upgrading and/or 
maintenance of equipment and/or purchase of services and/or subscriptions for the above 
mentioned interpretation and/or translation services . 

Appendix 1 

Disability-Related Tax Provisions Applicable to Businesses 
Excerpted from the ADA Handbook; Appendix G, Tax Provisions 

The three disability-related provisions in the Internal Revenue Code applicable to businesses 

described below are of particular interest to businesses and people with disabilities: 

1) Targeted Jobs Tax Credit (Title 26, Internal Revenue Code, section 51) 

Employers are eligible to receive a tax credit in the amount of 40 percent of the first $6,000 of 

first-year wages of a new employee who has a disability. There is no credit after the first year of 
employment. For an employer to qualify for the credit, a worker must have been employed for at 
least 90 days or have completed at least 120 hours of work for the employer. The Revenue 
Reconciliation Act of 1990, Public Law 101-508, extended this tax credit through December 31, 
1991. 

2) Tax Deduction to Remove Architectural and Transportation Barriers to People with 
Disabilities and Elderly Individuals (Title 26, Internal Revenue Code, section 190) 
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Allows a deduction for "qualified architectural and transportation barrier removal expenses." 
Only expenditures that are for the purpose of making any facility or public transportation vehicle 
owned or leased by the tax payer for use in connection with his or her trade or business more 
accessible to, and usable by, handicapped and elderly individuals are eligible for the deduction. 
The taxpayer must establish, to the satisfaction of the Secretary of the Treasury, that the resulting 
removal of the barrier meets the standards promulgated by the Secretary with the concurrence of 
the U.S. Architectural and Transportation Barriers Compliance Board. 

For purposes of this section, a "handicapped individual" is any individual who has a physical or 
mental disability (including, but not limited tot deafness and blindness) which, for that individual, 
constitutes or results in a functional limitation to employment, or who has any physical or mental 
impairment that substantially limits one or more major life activities of that individual. 

The deduction may not exceed $15,000 for any taxable year. (The maximum deduction had been 
$35,000 prior to passage of Public Law 101-508 in 1990, which lowered the maximum 
deduction.) 

3) Disabled Access Tax Credit (Title 26, Internal Revenue Code, section 44) 

This tax credit is available to "eligible small businesses" in the amount of 50 percent of "eligible 

access expenditures" for the taxable year that exceed $250 but do not exceed $10,250. 

"Eligible small businesses" are those businesses with either: 

a) $1 million or less in gross receipts for the preceding tax year 

OR 

b) 30 or fewer full-time employees during the preceding tax year. 

"Eligible access expenditures" means amounts paid or incurred by an eligible small business for 
the purpose of enabling the small business to comply with applicable requirements under ADA. 


-39- 


Attorney Docket No. 63015. 801US01 

Certain types of expenditures are listed as included under the meaning of the term "eligible access 
expenditures." These include amounts paid or incurred: 

i) for the purpose of removing architectural, communication, physical, or transportation barriers 
that prevent a business from being accessible to, or usable by, individuals with disabilities; 

ii) to provide qualified readers, taped texts, and other effective methods of making visually 
delivered materials available to people with visual impairments; 

iii) to provide qualified interpreters or other effective methods of making aurally delivered 
materials available to individuals with hearing impairments; 

iv) to acquire or modify equipment, or devices for individuals with disabilities, or 

v) to provide other similar services, modifications, materials, or equipment. 

Expenditures that are not necessary to accomplish the above mentioned purposes are not eligible. 
Expenses in connection with new construction are not eligible. "Disability" has the same meaning as it 
does in the ADA. Barrier removals or the provision of services, modifications, materials, or equipment 
must meet standards promulgated by the Secretary in order to be eligible. 

The invention has been described in reference to particular embodiments as set forth 
above. However, only the preferred embodiment of the present invention, and but a few 
examples of its versatility are shown and described in the present disclosure. It is understood 
that the present invention is capable of use in various other combinations and environments, and 
is capable of changes or modifications within the scope of the inventive concept as expressed 
herein. Indeed, in still further embodiments, automated closed captioning can be used to deliver 
via a network, real-time, simultaneous language translations. Further still, electronic avatars can 
be utilized to provide fully mobile, wireless network interpreting and simultaneous translation 
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services enabling business travelers and tourists to have immediately available translation 
services irregardless of time or location. In other embodiments, a sign language motion 
electronic dictionary can be utilized to enable electronic based communication with direct 
interface between deaf and hearing-enabled parties. Applications for such dictionary could 
include, but is not limited to, remote ordering devices for fast food outlets, rental car outlets, and 
ticket purchase outlets. 

In another preferred embodiment, a plurality of user computers can be contained within a 
single housing system. For instance, with reference to Figures 3 and 4, two user computers can 
be contained within a single housing 24 having a first side 26 and a second side 28, wherein the 
means for receiving and transmitting the audio and visual information for the first user computer 
resides on the first side of the housing 26 and the means for receiving and transmitting the audio 
and visual information for the second user computer resides on the second side of the housing 

■ 

28. In one embodiment, the audio receiver and transmitter 30 is a microphone and the visual 
receiver 34 and transmitter is a camera and a screen. In this manner, and with reference to 
Figure 5, a user, such as a doctor, could stand across from the hearing impaired person such that 
the user is viewing a visual transmitter on the first side, such as a screen and the hearing 
impaired person is viewing a visual transmitter on the second side, such as a screen. In this 
embodiment, the interpreter is transmitted simultaneously to both the doctor and the hearing 
impaired such that interpretation services are provided. In still other embodiments, and with 
reference to Figure 6, each user could utilize a separate hand held device. It is to be understood 
that this description is not intended to limit the invention. Rather, the invention is intended to 
encompass all permutations on the invention. For instance, the embodiment in Figure 3 could 
also be utilized for foreign language interpretation services such that two user parties could 
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communicate via interpretive services provided by the hand held network device housing the two 

» 

user computers. 
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